Web Survey Bibliography
When a survey is offered in more than one mode of administration, the potential for bias attributable to the mode may threaten the cross-mode exchangeability of responses or comparability of results. We demonstrate the utility of Item Response Theory (IRT) in quantifying the presence of mode effects, providing insight into the nature of the effects, and adjusting cross-mode results without post-hoc adjustment. Such IRT applications are of interest when the survey instrument informs an underlying latent trait. We present a Bayesian hierarchical IRT model that can accommodate multiple modes of survey administration and provide cluster-level parameter estimates of the latent trait when observed groupings of respondents are of interest. We illustrate the model with data from a randomized mode experiment in which responding subjects within each of 45 evaluated institutions were randomly assigned to one of four response modes: mail, phone, IVR, and a mixed mode of mail with phone follow-up. Results indicate presence of form-wide mode of administration effects that differ across response categories and the underutilization of an interior response category in certain modes.
JSM Homepage (abstract)
Web survey bibliography (18)
- Virtual Cognitive Interviewing Using Skype and Second Life; 2013; Dean, E., Head, B., Swicegood, J. E.
- Using an Item Response Theory Approach to Measure Survey Mode of Administration Effects: Analysis of...; 2013; Mariano, L. T., Elliott, M. N.
- Survey Sidekick: Learning & designing scientifically sound surveys; 2013; Hsiao, I.-H., Malhotra, M., Joo, J., Chae, H. S., Natriello, G.
- Media tracker; 2012
- Specific mixed-mode methodology to reach sensory disabled people in quantitative surveys; 2012; Fontaine, S.
- The Usage of a Cloud Service as an Effective Way of Sharing Cognitive and Usability Test Information; 2012; Rouhunkoski, J., Godenhjelm, P.
- Using Text-to-Speech (TTS) for Audio-CASI; 2012; Couper, M. P., Kirgis, N., Buageila, S., Berglund, P.
- Data Quality from Low Cost Data Collection Methodologies; 2012; Traugott, M. W.
- IVR and web administration in structured interviews utilizing rating scales: exploring the role of motivation...; 2011; Yang, Y., Callegaro, M., Bhola, D. S., Dillman, D. A.
- The impact of next and back buttons on time to complete and measurement reliability in computer-based...; 2010; Hays, R. D., Bode, R., Rothrock, N., Riley, W., Cella, D., Gershon, R.
- Continuous Measurement of Musically-Induced Emotion: A Web Experiment ; 2009; Egermann, H., Nagel, F., Altenmueller, E., Kopiez, R.
- E-epidemiology : Adapting epidemiological methods for the 21st century; 2009; Bexelius, C.
- Mobile phone surveys in mixed mode environment; 2009; Vehovar, V.
- Social desirability bias in CATI, IVR and Web surveys: The effects of mode and question sensitivity; 2008; Kreuter, F., Presser, S., Tourangeau, R.
- IVR: Interactive voice technology; 2008; Miller-Steiger, D., Conroy, B.
- Does Voice Matter? An Interactive Voice Response (IVR) Experiment; 2004; Couper, M. P., Singer, E., Tourangeau, R.
- Humanizing self-administered surveys: experiments on social presence in web and IVR surveys; 2003; Tourangeau, R., Couper, M. P., Steiger, D. M., de Rouvray, C.
- Self-administered questions by telephone: Evaluating interactive voice response; 2002; Tourangeau, R., Steiger, D. M.,